Training Spiking Neural Networks with Metaheuristic Algorithms

نویسندگان

چکیده

Taking inspiration from the brain, spiking neural networks (SNNs) have been proposed to understand and diminish gap between machine learning neuromorphic computing. Supervised is most commonly used algorithm in traditional ANNs. However, directly training SNNs with backpropagation-based supervised methods challenging due discontinuous non-differentiable nature of neuron. To overcome these problems, this paper proposes a novel metaheuristic-based method for by adapting temporal error function. We investigated seven well-known metaheuristic algorithms called Harmony Search (HS), Cuckoo (CS), Differential Evolution (DE), Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Artificial Bee Colony (ABC), Grammatical (GE) as search carrying out network training. Relative target firing times were instead fixed predetermined ones, making computation function simpler. The performance our approach was evaluated using five benchmark databases collected UCI Machine Learning Repository. experimental results showed that had competitive advantage solving four classification datasets compared other algorithms, accuracy levels 0.9858, 0.9768, 0.7752, 0.6871 iris, cancer, diabetes, liver datasets, respectively. Among CS reported best performance.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Metaheuristic Optimization Algorithms for Training Artificial Neural Networks

Training neural networks is a complex task that is important for supervised learning. A few metaheuristic optimization techniques have been applied to increase the effectiveness of the training process. The Cuckoo Search (CS) algorithm is a recently developed meta-heuristic optimization algorithm which is suitable for solving optimization problems. In this paper, Cuckoo search is implemented in...

متن کامل

Comparing Evolutionary Strategy Algorithms for Training Spiking Neural Networks

Spiking Neural Networks are considered as the third generation of Artificial Neural Networks, these neural networks naturally process spatio-temporal information. Spiking Neural Networks have been used in several fields and application areas; pattern recognition among them. For dealing with supervised pattern recognition task a gradientdescent based learning rule (Spike-prop) has been developed...

متن کامل

Metaheuristic Algorithms for Convolution Neural Networks

A typical modern optimization technique is usually either heuristic or metaheuristic. This technique has managed to solve some optimization problems in the research area of science, engineering, and industry. However, implementation strategy of metaheuristic for accuracy improvement on convolution neural networks (CNN), a famous deep learning method, is still rarely investigated. Deep learning ...

متن کامل

Adversarial Training for Probabilistic Spiking Neural Networks

Classifiers trained using conventional empirical risk minimization or maximum likelihood methods are known to suffer dramatic performance degradations when tested over examples adversarially selected based on knowledge of the classifier’s decision rule. Due to the prominence of Artificial Neural Networks (ANNs) as classifiers, their sensitivity to adversarial examples, as well as robust trainin...

متن کامل

Training Deep Spiking Neural Networks Using Backpropagation

Deep spiking neural networks (SNNs) hold the potential for improving the latency and energy efficiency of deep neural networks through data-driven event-based computation. However, training such networks is difficult due to the non-differentiable nature of spike events. In this paper, we introduce a novel technique, which treats the membrane potentials of spiking neurons as differentiable signa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2023

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app13084809